Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add modulefile for Dogwood/Cactus #1073

Merged
merged 9 commits into from
Apr 26, 2024
Merged

Add modulefile for Dogwood/Cactus #1073

merged 9 commits into from
Apr 26, 2024

Conversation

CoryMartin-NOAA
Copy link
Contributor

While we are technically not supposed to build our own CRTM or FMS, we are asking for forgiveness and forging ahead. This PR should allow GDASApp to compile on WCOSS2 (Dogwood and Cactus) after a minor issue is resolved. That issue being a compile issue in IODA that Ron is already aware of and has a fix that works (https://github.com/JCSDA-internal/ioda/compare/develop...bugfix/read_script_convert_fix).

Copy link
Contributor

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cloned feature/wcoss2 on WCOSS2 (Cactus). Execute ./build.sh -v -f. Build failed with

/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/bundle/ioda/src/engines/ioda/src/ioda/Engines/ReadScriptFile.cpp(25): error: no suitable constructor exists to convert from "\
double" to "std::variant<std::__cxx11::string, int, double>"
        return std::stod(argValue);
               ^

compilation aborted for /lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/bundle/ioda/src/engines/ioda/src/ioda/Engines/ReadScriptFile.cpp (code 2)

This sounds like the IODA problem we are already aware of and are fixing.

modulefiles/GDAS/wcoss2.intel.lua Show resolved Hide resolved
danholdaway
danholdaway previously approved these changes Apr 25, 2024
Copy link
Contributor

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve pending resolution of IODA compilation error.

@CoryMartin-NOAA
Copy link
Contributor Author

I'll mark this as ready for review once I am able to update the submodules when the IODA pull request is merged in

@CoryMartin-NOAA CoryMartin-NOAA marked this pull request as ready for review April 26, 2024 17:36
@CoryMartin-NOAA CoryMartin-NOAA self-assigned this Apr 26, 2024
@CoryMartin-NOAA CoryMartin-NOAA added hera-GW-RT Queue for automated testing with global-workflow on Hera orion-GW-RT Queue for automated testing with global-workflow on Orion labels Apr 26, 2024
@emcbot emcbot added hera-GW-RT-Running Automated testing with global-workflow running on Hera and removed hera-GW-RT Queue for automated testing with global-workflow on Hera labels Apr 26, 2024
Copy link
Contributor

@RussTreadon-NOAA RussTreadon-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update working copy of feature/wcoss2 on Cactus. ./build.sh -f -v ran to completion.

Approve.

@RussTreadon-NOAA
Copy link
Contributor

Shall we try to run ctest -R test_gdasapp on WCOSS2 or are additional changes needed? I think we need PBS equivalents of SLURM stuff.

@CoryMartin-NOAA
Copy link
Contributor Author

@RussTreadon-NOAA we can try, but as you note I expect it won't be trivial. I would suggest we tackle that in a subsequent PR.

@RussTreadon-NOAA
Copy link
Contributor

Simply loaded wcoss2.intel module and executed ctest -R test_gdasapp from build/ with the following result

Test project /lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build
      Start 1337: test_gdasapp_util_coding_norms
 1/22 Test #1337: test_gdasapp_util_coding_norms .............   Passed    3.03 sec
      Start 1338: test_gdasapp_util_ioda_example
 2/22 Test #1338: test_gdasapp_util_ioda_example .............***Failed    0.27 sec
      Start 1339: test_gdasapp_util_prepdata
 3/22 Test #1339: test_gdasapp_util_prepdata .................   Passed    0.48 sec
      Start 1340: test_gdasapp_util_rads2ioda
 4/22 Test #1340: test_gdasapp_util_rads2ioda ................   Passed    0.11 sec
      Start 1341: test_gdasapp_util_ghrsst2ioda
 5/22 Test #1341: test_gdasapp_util_ghrsst2ioda ..............   Passed    0.10 sec
      Start 1342: test_gdasapp_util_smap2ioda
 6/22 Test #1342: test_gdasapp_util_smap2ioda ................   Passed    0.10 sec
      Start 1343: test_gdasapp_util_smos2ioda
 7/22 Test #1343: test_gdasapp_util_smos2ioda ................   Passed    0.10 sec
      Start 1344: test_gdasapp_util_viirsaod2ioda
 8/22 Test #1344: test_gdasapp_util_viirsaod2ioda ............   Passed    0.10 sec
      Start 1345: test_gdasapp_util_icecamsr2ioda
 9/22 Test #1345: test_gdasapp_util_icecamsr2ioda ............   Passed    0.10 sec
      Start 1618: test_gdasapp_check_python_norms
10/22 Test #1618: test_gdasapp_check_python_norms ............   Passed    3.72 sec
      Start 1619: test_gdasapp_check_yaml_keys
11/22 Test #1619: test_gdasapp_check_yaml_keys ...............   Passed    0.15 sec
      Start 1620: test_gdasapp_jedi_increment_to_fv3
12/22 Test #1620: test_gdasapp_jedi_increment_to_fv3 .........   Passed    0.46 sec
      Start 1621: test_gdasapp_fv3jedi_fv3inc
Could not find executable srun
Looked in the following places:
srun
srun
Release/srun
Release/srun
Debug/srun
Debug/srun
MinSizeRel/srun
MinSizeRel/srun
RelWithDebInfo/srun
RelWithDebInfo/srun
Deployment/srun
Deployment/srun
Development/srun
Development/srun
Unable to find executable: srun
13/22 Test #1621: test_gdasapp_fv3jedi_fv3inc ................***Not Run   0.00 sec
      Start 1622: test_gdasapp_soca_nsst_increment_to_mom6
14/22 Test #1622: test_gdasapp_soca_nsst_increment_to_mom6 ...***Failed    1.10 sec
      Start 1623: test_gdasapp_snow_create_ens
15/22 Test #1623: test_gdasapp_snow_create_ens ...............   Passed    0.54 sec
      Start 1624: test_gdasapp_snow_imsproc
16/22 Test #1624: test_gdasapp_snow_imsproc ..................***Failed    0.11 sec
      Start 1625: test_gdasapp_snow_apply_jediincr
17/22 Test #1625: test_gdasapp_snow_apply_jediincr ...........***Failed    0.12 sec
      Start 1626: test_gdasapp_snow_letkfoi_snowda
18/22 Test #1626: test_gdasapp_snow_letkfoi_snowda ...........***Failed    0.59 sec
      Start 1627: test_gdasapp_convert_bufr_adpsfc_snow
19/22 Test #1627: test_gdasapp_convert_bufr_adpsfc_snow ......***Failed    0.03 sec
      Start 1628: test_gdasapp_convert_bufr_adpsfc
Could not find executable /lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
Looked in the following places:
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Release/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Release/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Debug/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Debug/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/MinSizeRel/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/MinSizeRel/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/RelWithDebInfo/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/RelWithDebInfo/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Deployment/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Deployment/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Development/bufr2ioda.x
/lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Development/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Release/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Release/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Debug/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Debug/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/MinSizeRel/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/MinSizeRel/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/RelWithDebInfo/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/RelWithDebInfo/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Deployment/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Deployment/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Development/bufr2ioda.x
lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/Development/bufr2ioda.x
Unable to find executable: /lfs/h2/emc/da/noscrub/russ.treadon/git/GDASApp/wcoss2/build/bin/bufr2ioda.x
20/22 Test #1628: test_gdasapp_convert_bufr_adpsfc ...........***Not Run   0.00 sec
      Start 1629: test_gdasapp_convert_gsi_satbias
21/22 Test #1629: test_gdasapp_convert_gsi_satbias ...........   Passed    2.02 sec
      Start 1630: test_gdasapp_aero_gen_3dvar_yaml
22/22 Test #1630: test_gdasapp_aero_gen_3dvar_yaml ...........***Failed    0.07 sec

59% tests passed, 9 tests failed out of 22

Label Time Summary:
gdas-utils    =   4.38 sec*proc (9 tests)
script        =   4.38 sec*proc (9 tests)

Total Test time (real) =  14.22 sec

The following tests FAILED:
        1338 - test_gdasapp_util_ioda_example (Failed)
        1621 - test_gdasapp_fv3jedi_fv3inc (Not Run)
        1622 - test_gdasapp_soca_nsst_increment_to_mom6 (Failed)
        1624 - test_gdasapp_snow_imsproc (Failed)
        1625 - test_gdasapp_snow_apply_jediincr (Failed)
        1626 - test_gdasapp_snow_letkfoi_snowda (Failed)
        1627 - test_gdasapp_convert_bufr_adpsfc_snow (Failed)
        1628 - test_gdasapp_convert_bufr_adpsfc (Not Run)
        1630 - test_gdasapp_aero_gen_3dvar_yaml (Failed)
Errors while running CTest

Errors are not surprising.

@RussTreadon-NOAA
Copy link
Contributor

Agreed. Let's merge this PR into develop. Being able to compile GDASApp on WCOSS2 is a great way to end the work week!

@CoryMartin-NOAA
Copy link
Contributor Author

@RussTreadon-NOAA yes, has been a long time coming!

@emcbot
Copy link

emcbot commented Apr 26, 2024

Automated Global-Workflow GDASApp Testing Results:
Machine: hera

Start: Fri Apr 26 17:56:06 UTC 2024 on hfe02
---------------------------------------------------
Build:                                 *SUCCESS*
Build: Completed at Fri Apr 26 18:46:13 UTC 2024
---------------------------------------------------
Tests:                                 *SUCCESS*
Tests: Completed at Fri Apr 26 19:04:47 UTC 2024
Tests: 100% tests passed, 0 tests failed out of 45

@emcbot emcbot added hera-GW-RT-Passed Automated testing with global-workflow successful on Hera and removed hera-GW-RT-Running Automated testing with global-workflow running on Hera labels Apr 26, 2024
@CoryMartin-NOAA CoryMartin-NOAA merged commit a8daf6a into develop Apr 26, 2024
13 checks passed
@CoryMartin-NOAA CoryMartin-NOAA deleted the feature/wcoss2 branch April 26, 2024 19:05
danholdaway added a commit that referenced this pull request May 2, 2024
* develop:
  Visualize stats in simple html document (#1089)
  Time series of csv stats (#1086)
  Use the gdas bkg for the static B (#1084)
  Add module files to compile on AWS (#1082)
  The DA only uses the gdas bkg ... fixing again ... (#1079)
  Using ioda util to convert the datetime in AMSR2 converter (#1077)
  Add modulefile for Dogwood/Cactus (#1073)
  Addition of a switch for the cycling type (#1072)
  Added YAML, JSON, python files for assimilating VIIRS satwinds (#1055)
  No mpi for the ascii stats (#1070)
danholdaway added a commit that referenced this pull request May 3, 2024
* develop:
  Using ioda util to convert the datetime in AMSR2 converter (#1077)
  Add modulefile for Dogwood/Cactus (#1073)
  Addition of a switch for the cycling type (#1072)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hera-GW-RT-Passed Automated testing with global-workflow successful on Hera orion-GW-RT Queue for automated testing with global-workflow on Orion
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants